Entropy, divergence and distance measures with econometric applications
نویسندگان
چکیده
This paper provides a unified treatment of various entropy, divergence and distance measures and explores their applications in the context of econometric estimation and hypothesis testing. AMS Subject Classifications: 62H30, 94A17, 53A35
منابع مشابه
Information Measures via Copula Functions
In applications of differential geometry to problems of parametric inference, the notion of divergence is often used to measure the separation between two parametric densities. Among them, in this paper, we will verify measures such as Kullback-Leibler information, J-divergence, Hellinger distance, -Divergence, … and so on. Properties and results related to distance between probability d...
متن کاملDivergence measures based on the Shannon entropy
A new class of information-theoretic divergence measures based on the Shannon entropy is introduced. Unlike the well-known Kullback divergences, the new measures do not require the condition of absolute continuity to be satisfied by the probability distributions involved. More importantly, their close relationship with the variational distance and the probability of misclassification error are ...
متن کاملGeneralized Cross-entropy Methods with Applications to Rare-event Simulation and Optimization
The cross-entropy and minimum cross-entropy methods are well-known Monte Carlo simulation techniques for rare-event probability estimation and optimization. In this paper, we investigate how these methods can be extended to provide a general non-parametric cross-entropy framework based on 1-divergence distance measures. We show how the 2 2 distance, in particular, yields a viable alternative to...
متن کاملDecision making in medical investigations using new divergence measures for intuitionistic fuzzy sets
In recent times, intuitionistic fuzzy sets introduced by Atanassov has been one of the most powerful and flexible approaches for dealing with complex and uncertain situations of real world. In particular, the concept of divergence between intuitionistic fuzzy sets is important since it has applications in various areas such as image segmentation, decision making, medical diagnosis, pattern reco...
متن کاملGeneralized Cross-Entropy Methods
The cross-entropy and minimum cross-entropy methods are well-known Monte Carlo simulation techniques for rare-event probability estimation and optimization. In this paper we investigate how these methods can be extended to provide a general non-parametric cross-entropy framework based on φ-divergence distance measures. We show how the χ distance in particular yields a viable alternative to Kull...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2002